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Figure 2.4 

In supervised learning with a distal teacher the network 
output drives another system, T } which produces the final 
output. This makes the teacher's job easier because targets 

can be specified at a higher, less detailed, level. When 

Tis a known function, the low-level signals needed for 
network training can be derived from the high-level errors. 

ment learning, but less informative than in regular supervised learning. As in 
reinforcement learning, the network outputs act as inputs to another system, T 9 which 
transforms the network outputs into the final output. When T is well-defined or can be 
accurately modeled, errors in the overall system-output can be translated backwards to the 
low level network-output error signals needed for network training. When the overall 
targets can be specified simply, the teacher's job is simpler. 

Using the task of throwing a ball as an analogy, the network outputs are the numerous 
coordinated muscular actions needed to toss the ball and Tis the physics that transform 
these actions into a result. If the overall goal is to land a basketball in a hoop, the sight of 
it bouncing off the rim may be a high-level error signal. No coach can tell you exactly 
when and how to move each individual muscle, but they can provide high-level suggesti 
ons in terms you already know how to implement, for example, "put more spin on it." 
Knowledge of the situation then allows you to translate the high-level suggestion back to 
individual low-level actions. 

Simulation results for a simple robot arm controller are described in [200, 201, 199]. 
Given inputs representing a position (jc, y) 9 the desired network outputs are the joint 
angles that put the manipulator in this position (figure 2.5). Physical properties of the arm 
determine the relationship T between the network outputs (joint angle commands) and the 
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